The human ECG - nonlinear deterministic versus stochastic aspects 
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We discuss aspects of randomness and of determinism in electrocardiographic signals. In particular, we take a 
critical look at attempts to apply methods of nonlinear time series analysis derived from the theory of deterministic 
dynamical systems. We will argue that deterministic chaos is not a likely explanation for the short time variablity 
of the inter-beat interval times, except for certain pathologies. Conversely, densely sampled full ECG recordings 
possess properties typical of deterministic signals. In the latter case, methods of deterministic nonlinear time series 
analysis can yield new insights. 



1 Introduction 

The physiology of the human heart is well understood 
mechanistically. Clear relations between the heart rate 
and many regulatory influences are known. The shape 
of a single cycle ECG is understood in detail and can be 
related to the different actions of the heart during one 
cycle. On the other hand, electrocardiographic record- 
ings pose intricate problems of time series analysis due 
to the different nature of the dynamical processes on 
different time scales. The long-term evolution has been 
reported fl to show non-stationarity in the sense of 
power law correlations. At time scales of a few hun- 
dred beats, non-stationarity becomes less pronounced 
and the dominant feature are rapid, hardly predictable 
low-amplitude fluctuations in the instantaneous heart 
rate which is usually defined through inter-beat inter- 
vals. At the time scale of a heart beat, high resolution 
ECG signals show repetitive structures specific of the 
beating mechanism. A number of attempts have been 
made to analyse various aspects of cardiac time series 
in the context of nonlinear deterministic dynamical sys- 
tems. 

Deterministic chaos offers an interesting explanation 
for the emergence of aperiodicity and unpredictabil- 
ity. Since rather simple systems can exhibit chaos, one 
is lead to use nonlinear time scries methods to verify 
whether such a source of unpredictability is underlying 
a given observation. In fact, the concept of deterministic 
low-dimensional chaos has proven to be fruitful in the 
understanding of many complex phenomena despite the 
fact that very few natural systems have actually been 
found to be low-dimensional deterministic in the sense 
of the theory. In favourable situations this approach 
allows one to determine the number of active variables, 
the stability properties of the system with respect to per- 
turbations, and even the equations of motion, including 
applications like noise reduction or control. 

Deterministic chaos is not the only, and not even the 
most probable source of aperiodicity. The superposition 
of a large number of active degrees of freedom can pro- 
duce extremely complicated signals, which might not be 
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distinguishable from randomness. Stochasticity in the 
sense that a system is driven by processes whose dynam- 
ics are too complex to be inferred from the information 
stored in the observations is the most frequent source 
of unpredictability in open systems and field measure- 
ments. The fundamentals of deterministic chaos as a 
theory are by now well established and described in a 
rich literature (for example see || for an introduc- 
tory text). Nonlinear time series analysis based on this 
theoretical paradigm is described in two recent mono- 
graphs |p, 5 , and a number of conference proceedings 
volumes [3-|. 

Several authors have applied nonlinear time series 
methods to ECG data, with varying success. Many 
findings are accepted positively by cardiologists, but 
have been contested by more mathematically oriented 
researchers. One of the strongest arguments, the ability 
to apply chaos control techniques |9|], has recently been 
put in question by the successful control of a stochas- 
tic process [fjot - From the understanding of physio- 
logical mechanisms like the regulatory system and the 
conduction system, one is lead to expect certain deter- 
ministic structures. However, the average heart rate of 
the healthy heart depends deterministically on several 
different processes, which in turn depend on other in- 
fluences, so that this dependency altogether might be 
far too complicated to be observable as a determinis- 
tic process through ECG data alone. It is our point 
of view, and we will give some non-exhaustive support, 
that ECG data does not prove heart rate variablity to 
be the result of an autonomous deterministically chaotic 
system. We will however demonstrate that even with- 
out determinism there are situations in which nonlinear 
time series analysis yields new insights. 

2 Determinism from time series 

Determinism in the mathematical sense means that 
there exists an autonomous dynamical system, defined 
typically by a first order ordinary differential equation 
x = f(x) in a state space T C H D , which we assume to 
be observed through a single measurable quantity /i(x). 
The system thus possesses D natural variables, but the 
measurement is a usually nonlinear projection onto a 
scalar value (the following discussion can be straight- 
forwardly extended to multi-channel measurements). In 



order to recover the deterministic properties of the sys- 
tem, we have to reconstruct an equivalent of the sub- 
space of T which is explored by the solutions of the 
system from the observations. The time delay embed- 
ding method is a way to do so that can be derived 
with mathematical rigour 111] ]. From the sequence of 
N scalar observations Si, S2, ■ ■ ■ , sjv, overlapping vectors 
s„ = (s„, s n _ T , . . . , s„_( m _ 1)r ) are formed (r is a delay 
time). For mathematically perfect, noise free observa- 
tions s n , it is proven that for m > 2Df there exists 
a one-to-one relation between s„ 6 R m and the unob- 
served vectors x„ in the state space, from which the 
measurements were taken. Here Df is the box-counting 
dimension of the attractor, that is, of the set in state 
space which is visited asymptotically by a trajectory. 

The standard approach towards establishing low- 
dimensional determinism in a scalar time series consists 
of constructing spaces with increasingly larger m and 
to search for deterministic structures in each of these 
spaces. A common tool is the correlation dimension in- 
troduced by Grassberger & Procaccia [|l2|, which tests 
for self-similarity of the set of points and thus for the 
existence of a finite dimensional attractor. Despite the 
existence of several pitfalls, this is still the method of 
choice when a finite dimension is to be established. Since 
contamination by about 2% of noise usually suffices to 
destroy all nontrivial self-similarity, dimension estimates 
per se cannot be recommended in field measurements, 
even if they stem from a deterministic source plus obser- 
vational noise. A more promising approach is to estab- 
lish the existence of nontrivial dynamical correlations by 
cither directly constructing equations of motion (fore- 
cast maps) or by proving an enhanced predictability, 
when the dimensionality of the embedding space is suf- 
ficiently high. 

3 Inter-beat intervals 

In this article we discuss exclusively electrocardio- 
graphic (ECG) data jl3| measured with surface elec- 
trodes. Some arguments can be carried over to invasive 
recordings as well. The ECG signal reflects the electro- 
chemical activity of the cardiac muscle fibres, integrated 
over the whole surface with a local weight factor, de- 
pending on the relative distance and electrical conduc- 
tivity between each point and the electrode. 

In studies of the heart rate variablity, often the long- 
term ECG recording is reduced to the sequence of inter- 
beat time intervals (RR-intervals), as defined by the 
time between consecutive R-waves. (See Goldberger and 
Goldberger jl4| for an introduction to clinical electrocar- 
diography and definitions of the nomenclature.) How- 
ever, there is a fundamental difference between the full 
ECG trace and the sequence of inter-beat intervals. In 
the latter, the "time" index is given by the event num- 
ber and the observable by the time elapsing in between 
two events. This time is not obviously a phase space 
observable in the sense of embedding theory, but re- 
cent work [|l5],|l6| implies that in principle RR-intervals 
may be suited to search for determinism in the ECG. 
However, attractors reconstructed from inter-bear time 
intervals of similar duration possess extremely small di- 
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Figure 1: Simultaneous measurements of breath and heart 
rates [jnj], upper and middle trace. The lower trace contains 
a randomised sequence preserving the autocorrelation struc- 
ture and the cross correlation to the fixed breath rate series. 
The surrogate data mimic much of the structure contained 
in the data, but not all of it. 



ameters. Small errors or noise in the time intervals can 
easily extinguish all nontrivial sub-structure. 

If indications of deterministic structure are weak, one 
can first try to reject certain null- hypotheses. One of 
the simplest is that the data stem from a stationary 
linear Gaussian random process (GRP). It is obviously 
too simple and can be rejected for most interesting data 
sets, since the marginal distributions are almost never 
Gaussian. The default explanation for this fact are 
static nonlinearities, that is, nonlinearities in the mea- 
surement process, which have nothing to do with the 
dynamics, but may hide the original character of the 
process. Time reflection invariance, which is another 
property of GRPs, is not affected by static nonlineari- 
ties in the measurement. It can, however, be affected by 
a memory effect of the measurement device, for example 
by a simple causal low-pass filter on the data. 

In order to test against a composite null hypothesis, 
one can produce new data, so called surrogates, and 
compare the original data and the surrogates by help of 
a suitably chosen test statistics. The advantage is that 
we do not have to specify, for example, which particu- 
lar process generated the data but we can test if any 
GRP could be underlying. For this approach, first an 
ensemble of surrogate data sets has to be produced. If 
the null hypothesis is that all structure of the data is 
fully described by their marginal distribution and by 
their auto-correlation function (equivalently, by their 
power spectrum), one creates otherwise random data 
with exactly the same power spectrum and marginal 
distribution JlJ, This simple test will often yield a 
rejection of the null and thus suggest the existence of 
additional, nonlinear structure, but can also be caused 
by non- stationary features which are common in clinical 
time scries and which are not compatible with the null 
hypothesis. 

Figure |l| illustrates the variation of the heart rate 
(middle trace) of a human at rest in connection with 
the breath rate (upper trace). Here, the instantaneous 
heart rate was derived from the RR-interval series by 
a Fourier interpolation technique, see [[lTj for details. 
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Figure 2: Superposition of four consecutive R-waves. The 
length of the baseline interval between T- and P-wave varies, 
whereas the cycles from P to T look almost identical. 

The lower trace contains a randomised sequence that has 
the same autocorrelation structure and the same cross 
correlation to the fixed breath rate recording. These 
random surrogate data preserve much but not all of the 
structure observed in the measurements. The remaining 
structure, in particular a slight asymmetry under time- 
reversal, might be due to the measurement process. In 
any case the structure is not pronounced enough for any 
kind of deterministic modeling. 

It is hard to find nonlinearities in RR-interval time 
series beyond those which can be easily accounted for 
by the measurement process or by the coupling to the 
slower breath rate. We thus support the conclusion 
of P0| , that there is no clear evidence for determinism 
in RR-interval data. This does not mean that deter- 
minism is positively absent, but that potential deter- 
minism in the heart rate variability is too complex to be 
accessible through RR-interval data alone. The conser- 
vative working hypothesis, which is also implied by the 
widespread use of spectral characteristics, is that the 
process which governs the initiation of new cardiac cy- 
cles is effectively stochastic, superimposed by the regu- 
lations of the autonomous nervous system which control 
the average heart rate. This does not in itself exclude 
the possibility that methods for the characterisation of 
deterministic chaos (like dimension estimates, entropies, 
empirical symbolic encoding) can be exploited for diag- 
nostic purposes. In the next section we will show why 
despite the supposed lack of determinism certain non- 
linear analysis tools can be employed, focusing on the 
single cycle ECG wave. 

4 Embedding of single-cycle ECG waves 

The fact that the different parts of the single cycle 
ECG wave mirror well understood physiological pro- 
cesses which are repeated with considerable precision 
introduces determinism-like properties in the ECG sig- 
nal during the time between the beginning of the P-wave 
and the end of the T-wave. A simplified model of the 
ECG signal could consist of a concatenation of iden- 
tical PQRST complexes, with a time interval of short 
but random duration in between. This is motivated by 
Fig. ||, where 4 consecutive QRS-complexes from a long 
ECG recording are superimposed. Although in general 
there is much more variability in the wave-form, Fig. 
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Figure 3: Two-dimensional embedding of ECG data cover- 
ing a time of 20 s, plotted with a delay of 10 ms. 



shows impressively the reproducibility of the wave-form 
with random TP intervals in between. A more detailed 
study which is in progress shows that the whole vari- 
ablity of a single cycle ECG wave can be parametrised 
by a few, typically about 5, parameters. 

Single-cycle ECG-waves which can be well approxi- 
mated by lower dimensional surfaces. This fact allows 
to make use of methods of nonlinear time scries analysis 
which exploit the concept of phase space. In Fig. [| we 
show an ECG signal in a two-dimensional time delay em- 
bedding space. In this representation, the data seem to 
fall onto a two-dimensional ribbon, but including more 
delay coordinates one would find a higher dimensional 
hyper-tube. We do not say that the data lie on an "at- 
tractor" , since the object we see is not invariant in the 
strict sense: when accumulating more and more data, 
due to non-stationarity, they will fill more and more of 
the plane. Nevertheless, the heart rate variability and 
the unpredictability of the onset of the next heart cycle 
in this plot is hidden in the cluster around the origin, so 
that we see essentially the few-parameter set of single 
cycle segments. This will allow to approximate this set 
locally by smooth manifolds. 

Predictability. The existence of (approximate) con- 
straints like a containing manifold can be used to make 
short time predictions inside an ECG-cycle. Strict de- 
terminism would mean that a point in state space pos- 
sesses a unique future, and that nearby points have a 
similar future. Thus, collecting neighbours of the point 
whose future should be determined, we can average over 
the future of the neighbours to learn how the present 
signal will continue. This simplest implementation of 
phase space predictability exploits much more than just 
linear temporal correlations. The present state is char- 
acterised by a delay vector of sufficient length, or, oth- 
erwise said, by a segment of measurements. To ob- 
tain the predictions discussed below we select such a 
50 ms data segment, look for similar segments in the 
data base, and take the average over the continuations 
of all these similar segments as a prediction of the fu- 
ture of the this data segment. Let s„ = (s„, . . . , s n _4g) 
be the segment whose future should be determined, and 
(s„/, s„/_4 9 ) a similar segment, i.e. |s„_j-s n /_i| < 6 
for alii = 0, . . . , 49, then the prediction s n+ k k m s ahead 
is s n'+k averaged over all similar segments n' . In Fig. ^ 
we show a few typical results of such predictions (contin- 
uous lines) up to fc max =600 ms ahead (to be compared 
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Figure 4: Phase space predictions (continuous lines), com- 
pared to measurements (dotted lines): Using the last 50 mea- 
surements represented by the broken lines to the left of the 
arrow to characterise the present state, the future was pre- 
dicted. In panel A, predictions start 160 ms before the It- 
wave, in B 100 ms. In each panel, four different cycles are 
shown. 



to the measurements, dotted), starting from two differ- 
ent locations on an ECG cycle. In panel A, s„ is a 50 ms 
segment of data inside the interval between T- and P- 
wave. In panel B, s„ contains a good part of the P-wave. 
In Fig. we show an average of the prediction errors, 
the modulus of the difference between the predicted and 
the observed value, for different starting positions. The 
averages were made over 306 cycles. 

Let us emphasise three observations: (1) When mak- 
ing predictions for segments which contain only data be- 
fore the beginning of the P-wave (the two curves start- 
ing leftmost in Fig. ||) the predictions fluctuate quite 
soon, leading to large errors even a few steps ahead. 
Small fluctuations of this part of the signal are mis- 
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Figure 5: Average forecast errors for predictions from 1 to 
600 ms ahead. Predictions start from segments s n consisting 
of the 50 data items immediately before the dotted lines 
relating the position to the point in the ECG-cycle (reduced 
in size). All forecasts/data segments were synchronised by 
the zero crossing of the descending part of the R-wave. 




interpreted by the algorithm to indicate the beginning 
of the next P-wave. On this time scale, ECG data do 
not contain much information about the onset of the 
next heart beat. (2) As soon as the true beginning of 
the P-wave is covered by s n (the three other curves in 
Fig. |5|), predictions are very robust and accurate: Even 
the end of the T-wave (250 ms ahead) is predicted quite 
well, and the forecast errors are almost zero up to 400 ms 
ahead, the beginning of the next P-wave. (3) The pre- 
dictions do not become worse with increasing prediction 
time (up to the above mentioned 400 ms), as it would be 
for chaotic data. Altogether, these findings show that 
each cycle can be characterised by a single state vector. 
The initial part of the P-wave already determines posi- 
tion, amplitude and width of the T-wave. Of course, all 
this is in agreement with physiological knowledge. 

Noise reduction. Due to the sharp QRS-complexes, 
the power spectrum of an ECG signal is broad banded. 
Therefore, filters in Fourier space cannot be employed 
with great success. They might smooth the signal on 
average, but also destroy the structure of the QRS- 
complcx. However, nonlinear techniques originally de- 
signed for the treatment of noise in low-dimensional 
chaotic data can be applied, as long as the approxima- 
tion by a manifold introduces less errors than there are 
measurement errors on the data. 

Conceptual as well as technical issues of nonlinear 
noise reduction for chaotic data have been well discussed 
in the literature. (See H] for a review containing the 
relevant references.) Phase space projection techniques 
rely on the assumption that the signal of interest is ap- 
proximately described by a manifold that has a lower di- 
mension than some phase space it is embedded in, and 
only the noise contamination of the data drives them 
out of this hypersurface. Then noise is reduced by first 
identifying the manifold in the noisy data and then by 
projecting the noisy data onto this manifold. This can 
be formalised as follows. Let {x„} be the states of the 
system at times n = 1, . . . , N, represented in some space 
lZ d . A (d — Q)-dimensional submanifold T of this space 
can be specified by F q (x) =0, q = 1, . . . , Q. Even if 
the data are not exactly constrained to we can always 
find {e„} such that = x„+e„ and F q (x n +e n ) = for 
all q, n. Then a/ (e 2 ) denotes the (root mean squared) 
average error we make by approximating the points {x„} 
by the manifold T . Assume that in a measurement we 
obtain noisy data y n = x„ + r\ n , where {r] n } is some 
random contamination. By projecting these values onto 
the manifold T we may find ~x! n = x„ + e„. If we can 
find a suitable manifold and carry out the projections 
such that (e 2 ) < (ij 2 ), then wc have reduced the obser- 
vational error more than we distorted the data. 

The most practical way to approximate data by a 
manifold is by local linear projections, which are ob- 
tained from local principal components. The procedure 
is illustrated in Fig. [| The correction is done for each 
embedding vector. Fig. [?] shows the result of the noise 
reduction scheme applied to a noisy ECG. For the pur- 
pose of noise reduction, embeddings in higher dimen- 
sions are advantageous. Fig. ^ was produced with delay 
windows covering 200 ms, that is, m = 50 at a delay 
time of 4 ms. Sec [E2| for more details on the nonlinear 





Figure 6: Illustration of the local projection scheme. For 
each point to be corrected, a neighbourhood is formed (grey 
shaded area) which is then approximated locally by an ellip- 
soid. An approximately two-dimensional manifold embedded 
in a three-dimensional space could for example be cleaned by 
projecting onto the first two principal directions. 
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Figure 7: Nonlinear noise reduction applied to electrocar- 
diogram data. Upper trace: original recording. Middle: the 
same contaminated with typical baseline noise. Lower: the 
same after nonlinear noise reduction. The enlargements on 
the right show that indeed clinically important features like 
the small downward deflection of the P-wave preceding the 
large QRS-complex are recovered by the procedure. Note 
that the noise and the signal have very similar spectral con- 
tents and could thus not be separated by Fourier methods. 



projective filtering of ECG signals. 

Fetal ECG extraction. Noise reduction can be re- 
garded as the particular case of the more general task 
of signal separation where one of the signals is the noise 
contribution. It turns out that the methodology de- 
veloped for noise reduction can be generalised to the 
separation of other types of signals. Here, we want 
to discuss the extraction of the fetal electrocardiogram 
(FECG) from non- invasive maternal recordings. Other 
very similar applications include the removal of ECG 
artefacts from electro-myogram (EMG) recordings (elec- 
tric potentials of muscle) and spike detection in electro- 
encephalogram (EEG) data. 

Fetal ECG extraction can be regarded as a three-way 
filtering problem since we have to assume that a ma- 
ternal abdominal ECG recording consists of three main 
components, the maternal ECG, the fetal ECG, and ex- 
ogenous noise, mostly from action potentials of inter- 
vening muscle tissue. The two ECG components and 
the noise have quite similar broad band power spectra 
and cannot be filtered apart by spectral methods. In 
Ref. [^H , it has been proposed to use a nonlinear phase 
space projection technique for the separation of the fe- 
tal signal from maternal and noise artefacts. A typical 
example of output of this procedure is shown in Fig. ||. 
The assumption made about the nature of the data is 
that the maternal signal is well approximated by a low- 



Figure 8: Signal separation by locally linear projections in 
phase space. The original recording (upper trace) contains 
the fetal ECG hidden under noise and the large maternal 
signal. Projection onto the manifold formed by the mater- 
nal ECG (middle) yields fetus plus noise, another projection 
yields a fairly clean fetal ECG (lower trace). The data was 
kindly provided by J. F. Hofmeister J25|] . 



dimensional manifold in delay reconstruction space. Af- 
ter projection onto this manifold, the maternal signal 
is separated from the noisy fetal component. Now it is 
assumed that the fetal ECG is also approximated by a 
low-dimensional manifold and the noise is removed by 
projection. Since both manifolds are curved, the projec- 
tions have to be made onto linear approximations. For 
technical details see Refs. |23). The algorithms for noise 
reduction and signal separation are publicly available as 
part of the TISEAN project Q. 

5 Non-stationarity 

The last issue we want to discuss in this paper is the 
inevitable problem of non-stationarity. As mentioned 
before, the ECG seems to show structures on all time 
scales, formalised by the notion of l//-noise. Most ob- 
viously, the heart rate changes depending on the phys- 
ical activity of an individual. On the other hand, from 
a diagnostic point of view, important information is 
contained in the variability which is summarised un- 
der the term non-stationarity. It is therefore impor- 
tant not to regard non-stationarity only as a complica- 
tion that arises for the statistical description of ECG 
data but as an important source of information. So far, 
there is no general methodology of extracting the rel- 
evant aspects from the vast amount of data collected 
in long-term recordings. A representation of the ECG 
in a (reconstructed) phase space may offer a powerful 
basis to trace changes in the wave-form. Consider an 
increase in the instantaneous heart rate. The ECG cy- 
cle will appear more condensed which is however not a 
simple rescaling described by one parameter. The wave- 
form will occupy a different part of the time delay em- 
bedding space. Searching for neighbours in this space, 
one will be able to identify similar situations in a long 
recording and thus be able to subdivide it into different 
phases ]|^,^7) ■ Due to the lack of chaos in the ECG case, 
the cross-prediction errors used in p7| can be replaced 
by phase space distances between data segments cover- 
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Figure 9: Gray-scale coding of the pairwise L 1 -distance be- 
tween single-cycle wave trains as a function of the cycle num- 
bers. A pixel at is encoded dark (black), if the wave 
trains i and j are similar (identical), and bright otherwise. 

ing the part of a cycle from the beginning of the P-wave 
until the end of the T-wave. In Fig. ^ we show a typical 
outcome of such a similarity study. The representation 
is similar to the well-known recurrence plot |Ba] where 
only recurrences of full P-to-T segments are considered. 

6 Conclusions 

One or two decades ago, chaos theory was received with 
great enthusiasm: It seemed to supply concepts for the 
analysis and understanding of aperiodic temporal evo- 
lution in arbitrary environments. During the last years 
disillusion prevailed, since it became clear that chaos 
in a stronger sense is hardly to be expected outside well 
controlled laboratory experiments. Much effort has been 
spent, or wasted, on the discussion "is it chaos or is it 
noise" . In almost all interesting dynamical problems in 
nature, stochastic fluctuations, intrinsic instability, and 
a changing environment act together to produce the in- 
triguing patterns we observe. Given that the human 
heart is also likely to be such a mixed system, we want to 
promote a different approach towards the issue by ask- 
ing what is a useful framework for the analysis of cardiac 
data. Due to the presence of approximately determinis- 
tic structures in the cardiac cycle, state space concepts 
can be applied with the necessary care when the typical 
time scales of a cycle are involved in the analysis. On 
longer time scales, the reduction of the available infor- 
mation to a single number, the RR-interval is too severe 
to still permit a useful study with phase space methods. 
When this reduction is avoided, comparisons in phase 
space may well be suitable to study the variability of 
the cardiac dynamics over longer times. 

We have argued that the heart dynamics contains a 
component which - at least on the basis of the informa- 
tion supplied by ECG recordings - has to be considered 
as stochastic. On the other hand, we have shown that 
the single cycle ECG wave can be represented by only 
a few parameters, or, cquivalently, by state vectors in 
a low-dimensional embedding space. We presented two 
applications, noise reduction and fetal ECG extraction. 
They demonstrate that the concepts of nonlinear time 
series analysis are powerful also for non-deterministic 
systems, if one is able to isolate a specific problem. 

This work was supported by the SFB 237 of the 



Deutsche Forschungsgemeinschaft. 
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